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Abstract 

We treat a discrete-time asset allocation problem in an arbitrage-free, generically 
incomplete financial market, where the investor has a possibly non-concave utility func¬ 
tion and wealth is restricted to remain non-negative. Under easily verifiable conditions, 
we establish the existence of optimal portfolios. 
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1 Introduction 

We consider investors trading in a multi-asset and discrete-time financial market who are 
aiming to maximise their expected utility from terminal wealth. If the utility function 
u is defined on the non-negative half-line, is concave, and the problem has a finite value 
function, then there is always such a strategy, see Rasonyi and Stettner [19]. In a general 
semimartingale model one needs to assume, in addition, that the so-called “asymptotic 
elasticity at + 00 ”, denoted by AE + {u ), is less than one in order to obtain an optimal 
portfolio for the utility maximization problem, see Kramkov and Schachermayer [15] and 
Remark 2.11 below. In the utility maximisation context, conditions on the asymptotic 
elasticity (which were first used in Cvitanic and Karatzas [8]; Karatzas, Lehoczky, Shreve, 
and Xu [12]; Kramkov and Schachermayer [15]) have become standard in the literature. 

In this paper we want to remove the assumptions of concavity and smoothness that are 
usually made on u. Why? Several reasons can be invoked. The first one is quite clear: 
the investor can change her perception of risk above a certain level of wealth. One can 
also consider the problem of optimizing performance at some level B: one penalizes loss 
under B with a loss function and one maximizes gain after B with a gain function. These 
illustrations are typical examples of a piecewise concave function. This kind of problem has 
been addressed in the complete case by Carassus and Pham [4] and in a pseudo-complete 
market by Reichlin [20]. 

Other examples of non-concave utility functions are the so-called “5-shaped” functions. 
These appeared in cumulative prospect theory (or OPT for short, see Kahneman and Tversky 
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[14]; Tversky and Kahneman [23]). This theory asserts that the problem’s mental represen¬ 
tation is important: agents analyse their gains or losses with respect to a given stochastic 
reference point B rather than with respect to zero and they take potential losses more into 
account than potential gains. Note that in this paper, in contrast to cumulative prospect 
theory, we do not allow investors to distort the probability measure by a transformation 
function of the cumulative distributions. The case of “5-shaped” functions was studied by 
Berkelaar, Kouwenberg and Post [1] in a complete market setting. 

In the present paper we provide mild sufficient conditions (involving asymptotic elastic¬ 
ity) on a possibly non-concave, non-differentiable and random utility function defined on 
the non-negative half-line which guarantee the existence of an optimal strategy. By treating 
multi-step discrete-time markets, we cover a substantial class of incomplete models which 
can be fitted to arbitrary econometric data. 

The case of (non-random) utilities defined on the whole real line was treated in Carassus 
and Rasonyi [5], but so far there were no general results in the case of the non-negative 
half-line; in the present setting we are only aware of Chapter IV of Reichlin [21], where 
existence results were proved for some very specific market models. 

We finish by listing some references in the case of probability distortions in the spirit of 
cumulative prospect theory, because those results can be applied to our setup with weight 
functions equal to the identity. In the incomplete discrete-time setting, the papers of Caras¬ 
sus and Rasonyi [6]; Rasonyi and Rodriguez-Villarreal [17] study quite specific utility func¬ 
tions. In continuous-time studies, all the references make the assumption that the market 
is complete: see Jin and Zhou [11], Carlier and Dana [7], Campi and Del Vigna [3], Rasonyi 
and Rodrigues [16]. 

A brief outline of this article is as follows. Section 2 is dedicated to specifying the market 
model and to introducing the relevant notations. In Section 3 we formulate our main result. 
Next, in Section 4 we examine the problem in a one-step setting, whilst in Section 5 we 
prove our main result, using a dynamic programming approach. For the sake of a simple 
presentation, the proofs of some auxiliary results are collected in Section 6. 


2 Notation and set-up 

2.1 The market 

In what follows, we shall consider a frictionless and totally liquid financial market model 
with finite trading horizon T £ N, in which the current time is denoted by 0 and trading is 
assumed to occur only at the dates {0,1,..., T}. 

As usual, the uncertainty in the economy is characterised by a complete probability 
space (n,J?,P), where & is a cx-algebra on the sample space Cl, and P is the underlying 
probability measure (to be interpreted as the physical probability). Moreover, all the in¬ 
formation accruing to the agents in the economy is described by a discrete-time filtration 
F = {,9 t \ t £ {0,1,...,T}} such that coincides with the family of all P-null sets. Finally, 
we assume also that & = 

Next, we fix an integer d > 0 and consider a process 5 = {5*; t £ {0,1,..., T}}, so that 
St represents the time-f prices of d traded risky assets. Denoting by S" the family of all 
J^t-measurable random vectors £ : Cl —;> l n for each ntN and each t £ {0,1,..., T}, we 
assume that St £ S/ for every t £ {0,1,..., T}, i.e., 5 is F-adapted. We shall also assume, 
without loss of generality, that the risk-free asset in this economy has constant price equal 
to one at all times. Finally, for each t £ {1,..., T}, we define A St = St — St-i- 

We recall that a self-financing portfolio is a process <p = {(ft'-, t £ {1,..., T}}, with (ft £ 
Sj_ 1 for all £ £ {1,..., T}, and its wealth process Tif = |llf; t £ {0,1,..., T}| satisfies, for 


Page 2/23 


Non-concave utility maximisation on the positive real axis in discrete time 


every t £ 

t 

n? = n^ + ^2{cj> s ,AS s ) a.s. 

S=1 

Here (•,•) denotes scalar product in K. d and || • || is the corresponding Euclidean norm. 
We denote by $ the class of all self-financing portfolios. In addition, we shall impose the 
following trading constraint: the value of a portfolio should not be allowed to become strictly 
negative. So we say that a portfolio </> £ $ is admissible for xq > 0 (and we write 4> G ^(^o)) 
if, for every t £ {1,... , T}, the inequality Ilf > 0 holds a.s. with n[} = xq. Because of 
budget constraints, such a restriction is natural and frequently imposed, see e.g. Kramkov 
and Schachermayer [15]; Rasonyi and Stettner [19]. 

The following no arbitrage assumption stipulates that no investor should be allowed to 
make a profit out of nothing and without risk, even with a budget constraint. 

Assumption 2.1. The market does not admit arbitrage, i.e., 

for all Xq > 0, if 4> £ dt^o) with n^, > xq a.s., then Wtf = cco a.s. (NA) 

Remark 2.2. It is proved in Proposition 1.1 of Rasonyi and Stettner [19] that (NA) is 
equivalent to the classical no arbitrage condition: \/<fi £ $, ll!/ + > 0 a.s. implies that 
n°’ 0 = 0 a.s. where n!}’^ stands for the wealth process associated to 4> when starting with 
a zero initial wealth i.e. n[} = 0. 

Now fix t £ {1,... , T}. We know that there exists a regular conditional distribution of 
A St with respect to under the physical measure IP, which we shall denote by p AS t\^t-i _ 
By modifying on a P-null set, we may and will assume that p AS t\^t-i (., w ) j s a probability 
for all lo £ B. Let D t (uj) denote the affine hull in IR d of the support of P ASt ^ t ~ 1 (-,Lo). It 
follows from Theorem 3 in Jacod and Shiryaev [10] that, under (NA), D t (uj) is actually a 
linear space for P-almost every w. 

Given any J^-i-measurable random variable H > 0 a.s. (which can also be some constant 
x > 0), we set 

S?-r(5) = {£ G Etv H + (f, A S t ) > 0 a.s.} . 

We take to be the class of all random vectors f £ Ssuch that ^(w) £ D t (u>) for 
P-a.e. w. The notation (H) is self-explanatory. 

Proposition 2.3. The following two statements are equivalent, 

(i) (NA) holds true; 

(ii) for every t £ {1,..., T}, there exist &t—\-measurable random variables /3t > 0, Kt > 0 
a.s. such that, for every £ £ S^_ 1; the inequality 

P((£,AS t )<-A||£Hl^i-i)>«t (2.1) 


holds a.s. 

Proof. This follows from Proposition 3.3 in Rasonyi and Stettner [18] and Remark 2.2 above 
(see also Proposition 1.1 in Rasonyi and Stettner [19]). □ 

Remark 2.4. We notice that the above ‘quantitative’ characterisation of (NA) holds true 
only for J? t _i-measurable, Revalued functions £ which belong to D t a.s. This will motivate 
the use of orthogonal projections later on (cf. Section 4). 
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2.2 The investor 

Investors’ risk preferences are described by a (possibly non-concave and non-differentiable 
random) utility function. 

Definition 2.5 (Non-concave random utility). A random utility (on the non-negative 
half-line) is any function u : (0, +oo) x fl —> R verifying the following two properties, 

(i) for every x £ (0, +oo), the function u(x, •) : f2 —> M is immeasurable, 

(ii) for a.e. to £ fl, the function u(-,ui) : (0,+oo) —> R is non-decreasing and continuous. 

For each u £ ff for which (ii) holds, we set w(0,w) = lim x j,o u(x, u), and we define 
u(0,u>) = 0 otherwise. Note that u(0,u) may take the value —oo. 

Remark 2.6. As in this paper we restrict wealth to be non-negative, we consider utilities 
which are defined only over the non-negative real line. Continuity and monotonicity are 
standard assumptions. Also, as u will be used to assess the future wealth of the investor, it 
may well depend on economic variables and hence it can be random, see Example 2.9 below. 
Lastly, unlike most studies, we do not assume concavity or smoothness of u. A possible 
extension to u which is only upper semicontinuous will be subject of future research. 

We proceed by noticing that, since u(-,ui) is a monotone function for a.e. ui £ ft, the 
limit u(+oo,-) = lim x _> +00 u(x, •) exists a.s. (though it may not be finite), and we define 
u(+oo,w) = +oo otherwise. We shall require the following. 

Assumption 2.7. The negative part of u at 0 has finite expectation, that is, 1 

Ep[u _ (0, •)] <+ 00 . (2.2) 

Remark 2.8. If u is deterministic, then the above assumption is equivalent to u(0) > — oo. 
This is admittedly restrictive, as it excludes that u(x) behaves like ln(s) or —x a (with a < 0) 
in the vicinity of 0. It still allows, however, a very large class of utilities. For the moment we 
cannot dispense with this hypothesis as it is crucial in proving that dynamic programming 
preserves the growth condition (2.6) below (see part (v’J in the proof of Theorem 3.3 in 
Section 5). Note also that this assumption is the pendant of (10) in Assumption 2.9 in 
Carassus and Rasonyi [5] when the domain of the utility function is equal to the whole real 
line. 

We continue this subsection with an important example of a random utility function, in 
the spirit of cumulative prospect theory. 

Example 2.9 (Reference point). Within the CPT framework, every investor is assumed to 
have a reference point in wealth (also referred to as benchmark or status quo in the literature, 
see e.g. Bernard and Ghossoub [2], He and Zhou [9], Carassus and Rasonyi [6]), with respect 
to which payoffs at the terminal time T are evaluated. Therefore, investors’ decisions are 
not based on the terminal level of wealth (as it is assumed in the Expected Utility Theory 
of von Neumann and Morgenstern [24]), but rather on the deviation of that wealth level 
from the reference point. Note that, unlike in CPT, our setting does not include probability 
distortions (weight functions). 

Mathematically, a reference point is any fixed scalar-valued and ^"-measurable random 
variable B > 0 a.s. Thus, given a payoff X at the terminal time T and a scenario ui £ S2, 
the investor is said to make a gain (respectively, a loss) if the deviation from the reference 
level is strictly positive (respectively, strictly negative), that is, X(oj) > B(uj) (respectively, 
X(w) < B(u)). 

Note that B may be taken to be, for example, a non-negative constant (this is the case 
in Berkelaar, Kouwenberg and Post [1]; Bernard and Ghossoub [2]; Carassus and Pham [4]). 

1 Here ,r+ = i n ax { x, 0} and x~ = — m i n { x, 0 [ for every i £ R. Furthermore, in order to make the 
notation less heavy, given any function f : X —>- R, we shall write henceforth f±(x) = \j(x) for all x £ X. 
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The reference point can also be stochastic (for instance, to reflect the fact that the investors 
compare their performance to that of another investor acting in a perhaps different market). 
In this setting, the investor has a random utility defined as 

u(x, ui) = u(x — B(uj)) , x > 0, u) £ fl, (2-3) 

with u : (— ess sup B, +oo) —> K. a (deterministic) non-decreasing and continuous func¬ 

tion satisfying u(— esssup-B) > — oo (where we set u(-essswpB) = lim x ^_ esssup s u(x), as 
before). Obviously, Ep[it _ (0,-)] < + 00 , so Assumption 2.7 is true for u. 

We shall make the following assumption on the growth of the function u. 

Assumption 2.10. There exist constants 7 > 0 and x > 0, as well as a random variable 
c > 0 a.s. with Ep[c] < + 00 , such that for a.e. well, 

u(Xx,co) < X 1 u(x,lo) + A 7 c(w) (2-4) 

holds simultaneously for all A > 1 and for all x > x. Furthermore, Ep [u + (x, •)] < + 00 . 

Remark 2.11. For u deterministic, strictly concave and continuously differentiable, we recall 
that 

AE+(u) = limsup^S^ 

x —>-+oo uyx) 

denotes the asymptotic elasticity of u at +00 (see Kramkov and Schachermayer [15, p. 943]), 
and we always have AE + (u) < 1 (the reader is referred to Kramkov and Schachermayer [15, 
Lemma 6.1]). 

We know by Lemma 6.3 in Kramkov and Schachermayer [15] that AE+(u) equals the 
infimum of all real numbers 7 > 0 for which there exists some x > 0 such that, for all A > 1 
and all x >x, 

u(Xx) < X 1 u{x) (2-5) 

holds . 2 * From the proof of Lemma 6.3 of Kramkov and Schachermayer [15], it is clear 
that this characterisation of AE + (u) also holds true if u is not concave (but continuously 
differentiable). As this latter formulation (2.5) makes sense for possibly non-differentiable 
and non-concave u and arbitrary 7 > 0 as well, we follow Carassus and Rasonyi [5] and 
define the asymptotic elasticity at +00 of u as 

AE + (u) = inf {7 > 0 : 3 a; > 0 s.t. for a.e. w, u(Xx,co) < A 7 zi(x,a;), V A > 1, Wx >x} , 

with the usual convention that the infimum of the empty set is + 00 . 

Hence, using this generalized notion of asymptotic elasticity, we see that condition (2.4) 
holds if either AE + (u) < + 00 , or u is bounded above by some integrable random constant 
C > 0 a.s. and Assumption 2.7 holds. Indeed, in the first case this is trivial since (2.4) is 
implied by AE + (u) < 7 . In the second case, taking x = 0, we get that for every x > x and 
for every A > 1, 

u(Xx, uf) < C(uj) < X 7 C(w) = A 7 u(x, w) + A 7 \C{uj) — u(x, w)] 

< X 1 u{x , w) + A 7 \C(ui) — u(0, w)], 

which permits us to define c(w) = [C(io) — u(0,w)] + . As c(w) < C(lo)+u~ (0,co), Assumption 
2.7 shows that Ep [c] < + 00 . Note that in this case Ep [ u + (x , ■)] = Ep [u + (0, •)] < Ep[C] < 
+00 

We note that, if u is deterministic, concave and bounded above, then AE+(u) < 0 (again 
by Kramkov and Schachermayer [15, Lemma 6.1]), but this fails in the non-concave case. As 

2 To be precise, in the cited lemma there is strict inequality in (2.5) and it is required to hold for A > 1 

only. As easily seen, it works also for our version. 
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we will see, in Example 6.1 below, Assumption 2.10 holds true, but the asymptotic elasticity 
is equal to +oo. This shows that having finite asymptotic elasticity, despite being sufficient, 
is not a necessary condition for a function to verify Assumption 2.10. 

We immediately get that AE + (u) < +00 (and hence Assumption 2.10 holds) provided 
that u is deterministic, continuously differentiable and there exists some p > 0 such that 


0 < liminf 

tc—>-+oo 


u'{x) 

xP 


< ton sup^ 

x— f+oo XP 


< +OO. 


Indeed, if the above condition is true for u, then on the one hand it is possible to find m > 0 
for which there exists some x > 0 such that u'(x) > mx p for all x > x. But this implies 
that, for all x > x, 


u(x) — u(x) 


u'{y) dy > m 


x p+1 — x p+1 
p + 1 


On the other hand, we can find M > 0 for which there is % > 0 such that u'{x) < M x p 
for all x > Xm- Defining x = max {x_, Xm} > 0, noticing that we may assume that u(x) > 0 
without loss of generality, and combining the preceding inequalities finally gives 

xu'{ x) Mx p+1 

u(x) ~ ( x p+1 — x p+1 ) + u(x) 

for all x > x. therefore 

xu'(x) 

hmsup —< + 00 . 

x —^-(-00 UyX ) 

In particular, if u'(x) is asymptotically equivalent to a power function (that is, u'(x)/x p —> 1, 
as x —> + 00 ) then Assumption 2.10 holds. A multitude of piecewise concave or “S-shaped” 
functions (not only piecewise power functions) can be accomodated in this way, such as the 
ones considered in Berkelaar, Kouwenberg and Post [1]; Jin and Zhou [11]. 

At last, suppose that u is the utility of Example 2.9. If the conditions below are satisfied: 

(i) esssupB < + 00 ; 

(ii) there exist real numbers 7 > 0, x > 0 and C > 0 such that, for all A > 1 and all x > x, 

u(\x) < A 7 u(a;) + A 7 C; 


(in) the function u is continuously differentiable on its domain, and there are real numbers 
I\ > 0 and x > 0 such that, for all x > x, 

u\x) < K; 


then u fullfills Assumption 2.10. Indeed, setting x = max{a;,ir} + ess sup B > 0 yields 


i(Xx, to) = ul A 




< A 7 u(x— 


B(u 


A 


< A 7 u(a; - B{u)) + A 7 A'B(w) ( 1 — — ) -P A 7 C* 


for a.e. w, simultaneously for all A > 1 and x > x. Note that u + (lv, •) < u + (x) and the latter 
is deterministic. Hence, choosing c = K ess sup B + C (which is constant, thus trivially 
integrable) gives the claimed result. We conclude by pointing out that any funcion u which 
is concave for sufficiently large x satisfies the conditions (ii), (in) above. 

We may now deduce the following auxiliary result, which provides an estimate for all 
x > 0 , and not only for x > x. 
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Lemma 2.12. Under Assumption 2.10 there is a random variable C > 0 a.s. such that 
Ep[C] < +00 and, for a.e. ui, 

u + (\x,tv) < A 7 tt + (x,w) + A 1 C(uj) (2-6) 

simultaneously for all A > 1 and for all x > 0. 

Proof. See Appendix 6 . □ 


3 Main results 


The optimal portfolio problem consists in choosing the “best” investment in the given assets: 
the one which maximises the expected utility from terminal wealth. 

Definition 3.1. Let Assumption 2.7 be in force. Given any xq > 0, the non-concave 
portfolio problem with initial wealth xq on a finite horizon T is to find cf>* £ H/(a:o) such that 


v*(x 0 ) = sup jEp 
We call (f>* an optimal strategy. 

Remark 3.2. (i) Note that, due to Assumption 2.7, 


(n£(-),-j :^£ *(*„)} = e p u(n£* (.),•) 


(3.1) 


Ep 


u 



< Ep[u (0, •)] < + 00 , 


and the expectations in (3.1) above exist (though they may be infinite). It is also 
immediate to check that, the strategy <f> = 0 is in ^(so) f° r all A 0 , so the supremum 
is taken over a non-empty set. In particular, u*(cco) > Ep[it(a:o> •)] > — oo, under 
Assumption 2.7. 


(ii) One may inquire why the existence of an optimal <f>* is important when the existence of 
e-optimal strategies (f e (i.e., ones that are e-close to the supremum over all strategies) 
is automatic, for all e > 0 . 

Firstly, non-existence of an optimal strategy <fi* usually means that an optimiser se¬ 
quence { 0 1 /"; n £ N} shows a behaviour which is practically infeasible and counter¬ 
intuitive (see Example 7.3 of Rasonyi and Stettner [18]). 

Secondly, existence of </>* normally goes together with some compactness property 
which would be needed for the construction of eventual numerical schemes to find the 
optimiser. 

Here comes the main result of the present paper. It says that the optimisation problem 
(3.1) admits a solution. 

Theorem 3.3. Let Assumptions 2.1, 2.1 and 2.10 hold true. Assume further that, for every 
x 0 £ [ 0 , +oo), 

v *( xq ) < + 00 . (3.2) 

Then, for each xq £ [0, + 00 ), there exists a strategy (jf £ T(:ro) satisfying 


Ep 


»(n£* (•)>•)] =v*(x 0 ) 


(3.3) 


Proof. The proof will be given in Section 5, after appropriate preparations. We give here a 
brief description. A dynamic programming technique will be applied. This will allow us to 
split the original problem into several sub-problems involving a random utility function I/ t 
at time t. At each time step, we will find a one-step optimal solution based on the natural 
compactness provided by Lemma 4.7 below and on the random subsequence technique of 
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Kabanov and Strieker [13] (see Sections 4 and 6). Furthermore, we will prove that certain 
crucial properties of Ut, such as continuity and the growth condition (2.6), are preserved 
for the next iteration (i.e. for Ut- 1 ). These are the most involved arguments of the present 
paper. Finally, we shall paste together the one-step maximisers in a natural way to get a 
maximiser in (3.2). □ 


Remark 3.4. We would like to stress that, since Assumption 2.7 is in force, the well-posedness 
condition (3.2) is actually equivalent to the apparently stronger one 


sup Ep 



< Too. 


To see this, we recall that IIj, > 0 a.s. for every 4> £ ^(ccq), hence 


(3.4) 


sup Ep 
p(xq) 



< u*(xo)T sup Ep 
4>&'&( x o) 



< u*(:ro)TE P [u (0,-)] < Too. 


As a very simple, yet important example to which the preceding theorem clearly applies, 
we mention the case where S satisfies Assumption 2.1 and u(x , u) is bounded above by some 
integrable random constant C(co), for all x, and satisfies Assumption 2.7. Another relevant 
example is given by the following theorem. First, define 

W = {Y £ Ep[|K| p ] < Too for all p > 0} . (3.5) 

Theorem 3.5. Let Assumptions 2.1, 2.7 and 2.10 hold true with c,u + (x,-) £ W. Assume 
further that ||AiS)|| , l//3 t £ W for every t £ {1,..., T}, where the (3t are the random variables 
figuring in Proposition 2.3. Then, for every xq £ [0, Too), condition (3.2) is satisfied and 
there exists an optimal strategy <f>* £ 'F(a:o)- 

Proof. See Section 5. □ 


4 The one-step case 

In this section, we consider an ^"-measurable function Y : 12 — > R d , and a cr-algebra Sf C & 
containing all P-null sets of &. This setting will be applied in the multi-step case (see the 
subsequent section) with Sf = j £" t _\ and Y = AS), for every fixed t £ {1,,T}. 

Keeping in line with the notation of the previous section, we denote by S d the family of 
all ^-measurable functions £ : 12 —»• K. d . 

Moreover, let ^ : 3§(lBL d ') x f2 —> [0,1] be the unique (up to a set of measure zero) 
regular conditional distribution for Y given . By modifying it on a P-null set, we may 
and will assume that P y ^(-,w) is a probability for each ui. Now, for each ui £ LI, let 
supp(P 5 l^(-,u;)) represent the support of P 5 ^(-, 0 )) (which exists and is non-empty), and 
let D(w) denote the afhne hull of supp(P y ^(-, w)), that is, D(u>) = aff(supp(P i !*(•,<*;))). 
We shall also assume the following. 

Assumption 4.1. For a.e. u> £ fl, D(uj) is a linear subspace of R d . 

In addition, for every ^-measurable random variable H : 12 —> R satisfying H > 0 a.s. 
(and also for any constant x > 0 ), define the set 

E d (H) A {£ G E d : H + (£, Y) > 0 a.s.} . 

Finally, let E d denote the family of all functions £ £ E d such that £(w) £ D(ui) for a.e. 
u>. The notation E d (H) is self-explanatory. 

We shall also impose the following condition, which can be regarded as one-step absence 
of arbitrage (cf. Proposition 2.3). 
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Assumption 4.2. There exist Sf -measurable random variables ( 3 , k > 0 a.s. such that 

F((Z,Y)<-pm\\&)>Ka.s. (4.1) 

for all We may and will assume f3 < 1. 

Assumption 4.3. Let the function V : [0, +oo) x LI —> R satisfy both properties below: 

(i) for any fixed x £ [0, + 00 ), the function R(x, •) : SI —> R is measurable with respect to 

(ii) for a.e. to £ Ll, the function : [ 0 ,+ 00 ) — > R is continuous and non-decreasing. 

We shall also need the following integrability conditions. 

Assumption 4.4. For every x £ [0, + 00 ), 

ess sup E P \V + {x + (£(•) , F(-)}, -)| 1 #] < +00 a.s. (4.2) 

£€E d (x) 

Assumption 4.5. The conditional expectation ofV~{ 0,-) : SI — > [0,+oo) with respect to 
Sf is finite a.s., i.e., 

Ep[R _ (0, -)| S#] <+00 a.s. (4-3) 

Finally, we impose the following growth condition on V. 

Assumption 4.6. There exists a constant 7 > 0 and a random variable C > 0 a.s. such 
that Ep[C] < +00 and for a.e. ui, 

V + {\a :,w) < A 7 R+(a;,w) + A 7 C(w) (4.4) 

simultaneously for all A > 1 and for all x > 0. 

Next, we remark that denoting by £(w) the orthogonal projection of £(w) on D(oj) for 
some f £ 2 d , we have f £ S d and (f, Y) = (£, Y) a.s., the reader is referred to Carassus and 
Rasonyi [5, Remark 8 ] for further details. This means that any portfolio can be replaced 
with its projection on D without changing either its value or its desirability to the investor. 
We now recall that the set of all admissible strategies in D is bounded. 

Lemma 4.7. Assume that Assumption f.2 holds true. Given any xq > 0, there exists a 
Sf -measurable, real-valued random variable K Xo = xo/p > xq such that , for every x £ [0, xo] 
and for every f £ E, d (x), we have 

IKII < K x 0 a.s. (4.5) 

Proof. This is Lemma 2.1 in Rasonyi and Stettner [19]. □ 

As for the next lemma, it will allow us to apply the Fatou lemma to a sequence of 

conditional expectations tending to the essential supremum in (4.7) below. 

Lemma 4.8. Assume that Assumptions f.l, f.2, f.3, f.f, 4-5 and f.6 hold true. Given any 
x > 0, there is a non-negative random variable L' : Q —> R such that E[L'|Sf] < +00 a.s., 
and for every f £ S d (x) the inequality 

v + (x+(a-),Y (■)),.)<L X {.) (4.6) 

holds for all x with L x = (x 1 + l) L', outside a fixed P-null set. 

Proof. See Section 6 . □ 

Now a regular version of the essential supremum is shown to exist. 
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Lemma 4.9. Assume that Assumptions 4-1, 4-2, 4-3, 4-4> 4-5 and, 4-6 hold true. There 
exists a function G : [0, +oo) x Q —> R satisfying the two properties below: 

(i) the function G(x, •) is a version of ess sup^ gS d( x ) Ep[ V(x + (£(•) ,Y (-)), - )| Sf] for each 
x G [0, +oo) ; 

(ii) forE-a.e. w G Q, the function G(-,ui) : [0, + 00 ) — > K. is non-decreasing and continuous 
on [0, +00). 

Furthermore, given any Sf -measurable random variable H > 0 a.s., 


G(H(-) , •) = esssup E P [V(H(-) + <£(•), ¥(■)), -)| Sf] a.s. (4.7) 


Proof See Appendix 6 . 


□ 


Proposition 4.10. Assume that Assumptions 4-1, 4-2, 4-3, 4-4 > 4-5 and 4-6 hold true. For 
every -measurable random variable H > 0 a.s., there exists £(H) (•) G E d (H) with 


G(H(.) , ■) = E, [V(H + (t(H) (•), F(-)) , •) 


(4.8) 


Proof. See Section 6 . 


□ 


5 The multi-step case 


In this section, we shall follow Carassus and Rasonyi [5]; Rasonyi and Stettner [18, 19], and 
employ a dynamic programming approach to split the original optimisation problem into a 
number of sub-problems at different trading dates. Our goal is to invoke the results of the 
preceding section, thus allowing us to obtain an optimal solution at each stage. Combining 
them in an appropriate way will yield a globally optimal investment strategy. 


Proof of Theorem 3.3. We must prove that some crucial assumptions of Section 4 are pre¬ 
served at each time step. So let us start by defining 

Ut(x,uj) = u(x,w) , i>0, well. 


We wish to apply the results of Section 4 with Y = A St, ^ — AFt-\ and V = Ut- 

(i) Since Assumption 2.1 holds by hypothesis, Theorem 3 in Jacod and Shiryaev [10] 
implies that the affine space Dt(oj) is a linear subspace of M. d a.s., therefore Assump¬ 
tion 4.1 is verified. It follows from Proposition 2.3 that Assumption 4.2 holds as well. 

(ii) We note further that Assumption 4.3 is also true from the definition of a random utility 
function. 


(Hi) We now claim that Assumption 4.4 is satisfied. In order to show this, fix an arbitrary 
x > 0. First we check that Ep[Ut(x + (£(•), A St(-)) , -)l &t- 1 ] is well-defined and 
finite a.s. for any given £ G E^_ 1 (x). It is straightforward to see that the Revalued 
process defined by 


rr \ a f £> ^ t = T, 

( 0 , otherwise, 


is a portfolio in 41 (x), with 


Ep 





E P [u+(x+(£(•), AR t (-)},-) | 

Ep [U+{x + (£(•), AS t (-)> , 0| #r-i] a.s. 
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In particular, the preceding equality and (3.4) imply that 


E P [E P [l/+(x+(£(•), AS t (-)),-)|^t-i]] 



< + 00 , 


and so E P [£7jT(a; + (£(•), A St(-)) , -)| ^r-i] < +oo a.s. (thus, the conditional expec¬ 
tation is well-defined and finite a.s. from Remark 3.2 (ij). 

Next, it can be easily shown that 

{E P [U+(x + <£(■), A5 t (-)) , -)| &t-i] ■■ C e H^O*)} 

is directed upwards, so we can find a countable sequence of random vectors {£„; n £ N} C 
E^-i(x) attaining the essential supremum, i.e., such that 


lim E P [U+(x + <£„(•) , A5 t (-)) , -)| &t-x] 

n—)-+oo L 1 J 

= ess sup E P [U^(x + (£(•), AS' t (-)) ,-)| &t-i\ a.s. 

in a non-decreasing way. Therefore, it follows from the Monotone Convergence Theo¬ 
rem and from the definition of conditional expectations that 


E P 


esssup E P [U$(x + (£(•), AS T (-)), -)| &t- i] 

Cesg,^*) 

= lim Ep[E p [£/+(*+ ^ n (-),AS T (-)),-)|^r-i]] 

n —>-+oo L L i jj 


= supEp [t/+ (x + (£„(■), A S T (-)) , •)] 

n£N 


= supEp 

nGN 



< +0O, 


where cj> n = <f>^ and we invoked (3.4) once again. 

Hence esssup^g^d ^ E P [U^(x + (£(•), ASt(-)) , -)| ^r-i] <+oo a.s. 

(iv) The next step is to show that Assumption 4.5 holds as well. In fact, due to Assump¬ 
tion 2.7, it is immediate that 


E p [E p [I7 t (0,-)| J^r-i]] = E p [[/ t (0, •)] =E P [u (0,-)] < +oo, 


so E P [[/ r (0,-)| <+oo a.s. 

(v) Lastly, let the constant 7 > 0 and the integrable random variable C(-) > 0 a.s. be 
those given by Assumption 2.10 and Lemma 2.12. Then, for a.e. u> £ H, 

[/+( \x,lj) =u + (\x,u) < X Y u+{x,ui) + C(io)y 7 = A T t/+(x,w) + C(w)A T (5.1) 

simultaneously for all A > 1 and x > 0. 

Now, by Lemma 4.9, there exists a function Gt- 1 : [0,+oo) xll->l such that, for 
every w in a P-full measure set, the function Gt-i(-,w) : [0, +00) — > R is non-decreasing 
and continuous on [0, +00) . Moreover, for every x £ [0, +00), 

G T - i(av)= esssup E r [U T {x + (£(•), AS T (-)) , -)l ^r-i] a.s. 

f 6 H T-l( X ) 
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In addition, Proposition 4.10 gives us, for each H £ an ,^r -1 -measurable function 

( H ) (•) : Cl —> such that 


Gt-i (H(-), ■) 


ess sup E p[U t (H(-) + (£(•), AS T (-)),-)l ^r-i] 
s^h) 


Ep 





a.s. 


(5.2) 


Let us now proceed to the next stage of dynamic programming. Let Ut- i : [0,+oo) x 
Cl — y M be the function given by Ut-i{x,uj) = As before, we would like to use 

the results of Section 4, this time with Y = ASV-i, ‘S — &t- 2 and V = Ut- i- 

(i’) Assumptions 4.1 and 4.2 are both true, as before. 

(ii’) Next, we prove that Assumption 4.3 holds. In fact, given any x > 0, the function 
Ut- i(x, •) : Cl —> R is ^r-i-measurable. On the other hand, for a.e. uj, we have by 
definition of Ut —i that Ut~i{-,uj) is a non-decreasing continuous function on [0, + 00 ). 

(in’) We show that we also have Assumption 4.4. Indeed, letting x > 0 be arbitrary, but 
fixed, it can be easily checked, in the same way as before (the construction of the 
portfolio becoming more involved, but totally analogous), that for every £ £ S^_ 2 (a;), 
the conditional expectation 


Ep [Ut~i(x + (£(•), ASt-i(-)) ) ')l &t- 2 ] 
is not only well-defined, but also finite a.s. Furthermore, 

esssup Ep [t/jL 1 ( a ' + (£(") > AS't-i(-)) , -)| J^T- 2 ] <+00 a.s., 


as desired. 

(m’) We proceed with the proof that Assumption 4.5 is also verified. Given any x > 0, it is 
clear that 

Ut-i(x, •) = Gt-i(x, •) > Ep [Ut(x, -)| &t- 1 ] a.s., 

where the inequality is due to 0 £ ’E^_ 1 {x) and to the definition of the essential 
supremum. Now we can use Jensen’s inequality (for the conditional expectation) to 
obtain 

Ep[Ep[L r T _ 1 (0, -)| &t- 2 ]] = Ep[{7 T _ 1 (0, •)] 

<Ep[E P [C^(0,-)|«^r-i]] =E P [C/f( 0 ,-)] = E P [u"(0, •)] , 

which in turn implies (recall Assumption 2.7) that Ep[[/^7_ 1 (0,-)| &t- 2 ] < +00 a.s. 
Note in passing that we have also proved that 

Ep^r-rM <E P [«-(0,-)] • (5.3) 


(v’) Take the constant 7 > 0 and the integrable random variable C(-) > 0 a.s. to be as in 
Assumption 2.10 and Lemma 2.12. We have that, for every A > 1 and x > 0, 


U 7 (A®,-) < Ep 


< A 7 Ep 


U+(\x + ^ T (Xx) (■), AS T (-)) , ■ 
U+(x + (Zt(\x) (•) /A, AS't(-) 


&T -1 

&T —1 


+ A 7 Ep[C(-)|^t-i] a.s., 
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where the first inequality follows from the conditional Jensen inequality and from (5.2) 
with H = Ax, the second one uses (5.1). Moreover, it is easy to see that fa( Ax) (•) /A £ 
5^_ 1 (x) and we obtain 


Ej 


= Ep 


•^T-l 


U+{x + {fa(Xx) (•) /A, A5t(-)) , 

U T (x + {fa(\x) (■) /A, ASt(-)) , •) 
U^(x+{fa(Xx) (-)/A,ASt(-)), 


J^T-1 


^T-l 


< E® 


U T (x + (fr(Ax) (•) /A, A 5 t (-)) , ') | ^x-i 
< Ut-i(x, ■) + Ep[t/ T (0, -)| J^r-i] a.s. 

So we conclude that, for every A > 1 and x > 0, 

17+_ 1 (Ax,-) < X T U+_ 1 (x,-) + X T C(-) a.s. 


+ Ep [U T (0, -)| &t- i] 


for C(-) = Ep[C'(-)| ^r-i]+Ep[[/y (0, - )| &t- i] < +oo a.s. by Assumption 4.5 for V = 
Ut ■ Moreover, Ep [£?(■)] = Ep[C'(-)]+Ep[u _ (0, •)] < +00 by Assumption 2.7. Using the 
regularity of the paths of Ut— 1 , we get that, for a.e. ui the inequality CA)t_ 1 (Ax, oj) < 
A 7 Uf_ 1 (x, u])+X 1 C{u>) holds simultaneously for all A > 1 and x > 0, so Assumption 4.6 
is verified. 


Consequently, we can apply Lemma 4.9 and Proposition 4.10 to obtain functions Gt-i 
and £t_i satisfying the desired properties. Proceeding in a similar way for the remaining 
values of t £ {T — 2,..., 1} (noting that, for the next step, (5.3) will allow us to conclude 
in step (v’) that Ep[tAp'_ 1 (0, •)] < + 00 ), we construct the functions Ut- 2 , ■ ■ ■ ,Ui,Uo and 

Ct- 2, ■ ■ ■ ,£i- 

We then inductively define lip = xo, ^i(-) — £i(xo) (•) and </>((•) = £t(nf ^ (•). The 
remainder of the proof, showing optimality of <f>*, unfolds exactly as the proof of Propo¬ 
sition 3.2 in Rasonyi and Stettner [19]. We report it here for convenience of the reader. 
Joint measurability of ensures that </>* is a predictable process with respect to the given 
filtration. Recall that we have proved that 

ess sup Ep [U+ (x + (£(•), AS t .{-)) , -)| <+00 a.s., 


so the all the conditional expectations below exist and are finite. 

It is easy to see that </>*(•) £ (llf j j , and Proposition 4.10 shows that, for t 
{1,...,T}, 


Ep 


U t 


( n f (■)>■) 




= Ep 


u t ( iCt(-) + {it (n U )(•), a.$(■)), •) 




So Ep 


Ui 


(nf (■),•) 

E, 




= Ep 


= j7 t _ 1 (nf 1 (-). 

-1 (nf ,(•),• 


^0 


a.s., and we deduce that 


Ut (nf (•),•) 




= Ep 


U 


(nf (•), 




= U 0 (x 0 ) a.s. 


(5.4) 


Now let <j> £ 'I'(xo). Clearly, fa £ Sr-i (ll ^,_ 1 j. Using Proposition 4.10 again, we 
obtain 


Ep 


U T (n*_fa) + (fa(-), ASt(-)) ,-)\^T-i] < Ut^ILt-! (•),•) a.s. 
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Iterating the same argument we get 


Ep 





< t/ 0 (x 0 ) a.s. 


and the theorem is proved, recalling (5.4). 


(5.5) 

□ 


Proof of Theorem 3.5. The proof unfolds exactly as that of Theorem 3.3, the only difference 
residing, for each time stage t € {T,..., 1} , in the verification that Assumption 4.4 is 
valid for the function Ut : [0, oo) x fl —► R which is defined recursively as in the proof of 
Theorem 3.3. More precisely (i), (ii), (iv), (v), (if, (ii’), (ivf and (v’) of the proof of 
Theorem 3.3 are exactly the same and will prove (in) and (in’) (and Assumption 4.4) using 
(5.6) below. Note that the assumption that v*(xq) < oo in the proof of Theorem 3.3 was 
only used in (iii) and (in’). 

We prove by backward induction on t that there exists some J ( € W such that 

U t (x,ui) < J t (w) [x 7 T l] (5.6) 


simultaneously for all x > 0, for lo outside a P-null set. Starting with t = T, we set 
Ut{ x, •) = u(x, •). Assumption 2.10 shows that, outside a P-null set, for all x > x, 


U T (x, •) = u(x, •) < (x/x) 7 [u + (x, ■) + c(-)], 

and for 0 < x < x, 

U T {x, •) < (x, •) = u + (x, •), 

so we can set 

J T {-) = max{ [it + (x, •) + cf^/x 1 ,u + (x, •)} , 

and the latter is clearly in W by our assumptions. 

Now, let us assume that the statement has been shown for T, T — 1,..., t + 1. Using 
Lemma 4.7, we can estimate 


U t (x,-) = esssvpE P [U t+ i(x+{£(■), AS t+ i(-)),-)\^ t ] 

< ess sup E P J t+ i(-) [x+ ||£(-)|| || AS’ t+ i (-)||] 7 + Jt+i() 

eesLjfx) 




< x 7 Ef 


j t+1 (-)[i+iiA5 t+1 (-)n/A + i(-)r 




Ep[J t+ i(-)l^t] a - S -5 


so we may set J t {•) = Ep 


€ W. This inequality has 


J m (-)[l + ||A5 t+1 (-)||M +1 (-)] 7 ^ 

been obtained for each x > 0 a.s., but using the regularity of the paths of Ut we get it for 
all x > 0 on a common P-full measure set. 

Now we show how (5.6) implies that Assumption 4.4 holds true and thus replaces (in) 
and (iii’) in the proof of Theorem 3.3. The argument is the same as above using that 
Jt+i > 0 a.s. and thus U(f(x,u>) < Jt(ou) [x 7 + l] for all x > 0 on a common P-full measure 
set. Thus 


ess sup Ep [f/ t + (x + (£(■), A S t {-)), -)| &t- i] 


< ess^supEp Jt(-) [x+ ||C(-)II II AS't (-)||] 7 + Jt() 

ieEf(x) 

< (x 7 + 1 )Tt-i(-) < +oo a.s. 




and Assumption 4.4 holds true. The end of proof of Theorem 3.5 follows verbatim the one 
of Theorem 3.3. 

Note that here we obtain that w*(xo) < oo for all Xq > 0. Indeed from (5.5) where 
(j) € 'L(xo) is arbitrary, we get that u*(xo) < Ep[[/o(xo, •)]• Thus v*(xo) < (l+Xo)Ep[J 0 (-)] < 
Too. 

□ 
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6 Appendix 

We are staying in the setting of Section 4. 

Example 6.1. It is not difficult to find (non-random) utilities which are bounded above and 
yet have non-zero (actually, infinite) asymptotic elasticity, as the example below shows. The 
construction below is inspired by the proof of Lemma 6.5 in Kramkov and Schachermayer 
[15]. Let / : [0,+oo) —> K. be the function which takes the values 

n a 1 1 _ n-1 

^ 2 n+ 1 2 (n + 1) ’ 

f(n + 1/2 - a n ) = f(n) + a n , 
f{n + 1/2 + a n ) = f(n + 1) - a n , 

with a n = 1/ [4 (n + 1) (n + 2)] for every n € N, and which is linear between the points 
where it has been defined. 

Clearly /(+oo) = 1/2 and /(1) = 0. We also note that /(0) = —1/2 > — oo. Moreover, 
the piecewise linearity of / and trivial computations yield 

s f{n + 1/2 + a n ) - f(n + 1/2 - a n ) 

J W = -o-= 1 

2 &n 

for any x € (n + 1/2 — a n , n + 1/2 + a n ), so in particular f'(n + 1/2) equals 1. Furthermore, 
we have the following inequality, 

/(n + 1/2) < f(n+ 1) = n 

n + 1/2 — n + 1/2 (n + 2) (2n + 1) ’ 

thus combining all of the above gives lim„_> +00 (n + 1/2) f'{n + 1/2) /f(n + 1/2) = +oo, 
and hence AE + (u) = +oo in the classical sense of Kramkov and Schachermayer [15]. We 
finish by noticing that, as in the proof of Lemma 6.5 in Kramkov and Schachermayer [15], 
/ can be slightly modified in such a way that it becomes smooth and our conclusion is still 
valid. So, as mentioned in Remark 2.11, Lemma 6.3 of Kramkov and Schachermayer [15] 
applies and 

limsup — 'l ^ = infjy > 0 : 3x > 0 s.t. a.e. /(Ax, •) < A 7 /(x, •), V A > 1, Vx > x} , 

x->+oo j{ x ) 

with the usual convention that the infhnum of the empty set is +oo, and / has an infinite 
asymptotic elasticity in both senses. Nevertheless, choosing x = 1, we have that 0 < /(x) < 
1/2 for x > x, and Assumption 2.10 holds true for u(x) = f(x). 

Proof of Lemma 2.12. Consider an arbitrary x € [0,x). Then we can use the fact that u is 
non-decreasing and inequality (2.4) to obtain for a.e. u> £ Ll that 

u(Xx,u) < u( Ax, uj) < A 7 u(x, w) + A 7 c(w) < A 7 m + (x, u>) + A 7 c(w) 

for any A > 1. As c > 0 a.s. this implies that u + ( Ax, w) < A 7 m + (x, oj) + A 7 c(w). On the 
other hand, for a.e. u> S O and every x > x, we have by (2.4) that 

rt(Ax, w) < A 7 [u(x, w) + c(w)] < A 7 [u + (x, w) + c(w)] 

for all A > 1. Using again that c > 0 a.s. we get that u + (Ax,w) < A 7 [u + (x,w) + c(w)] . 
Hence, choosing C(co) = u + (x, oj) + c(w) > 0 and combining the previous inequalities we get 
for a.e. we!! 

it + (Ax, u) < max {A 7 [u + (x, cu) + c(w)] , A 7 [u + (x, uj) + c(w)] } < A 7 u + (x, ui) + A 7 C(w) 

for all A > 1, x > 0. Lastly, note that Ep[C] < +oo since Ep[w + (x, •)] < +oo and Ep[c] < +oo 
by Assumption 2.10. □ 
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Proof of Lemma 4-8. Let 0 denote the set of functions from {1,..., d} to {— \fd, Vd}, and 
let x > 0. Then we have by Lemma 4.7 that, for all £ £ E d (x), 


hence 


x + (£, Y) < x (1 + || Y|| //3) < x 


1 + (1//3) max (t, Y) 


a.s., 


^ + (*+«(■). n)),o<^ + 


rG© 


< E v+ ( x t 1 + ( r /^(-) > y (-)>] > •) a - s -> 

ree 


where we define V + (x , uj) = 0 for x < 0. 

We know from Proposition 4.2 of Rasonyi and Stettner [19] that there is a random set 
M( 1) £ such that £ £ M(l) a.s. if and only if £ £ S d (l). Denoting the linear span 

of M(l)(w) by R{l)(u), R( 1) is again in Sf<g)^(R d ) by Proposition 4.3 of Rasonyi and Stet¬ 
tner [19]. It suffices to prove our lemma separately on the sets {w £ fl : dimR(l)(w) = /c}, 
with k £ {0,..., d}, since these sets are in <£ (see the proof of Proposition 4.3 in Rasonyi 
and Stettner [19]). Applying verbatim the arguments of Lemma 2.3 in Rasonyi and Stettner 
[19], one can show the existence of g £ S d (l) and of e T £ S 1 with s T £ (0,1) such that 
g T = g + e T ( t/(3 — g) belongs to M{ 1) and thus to S d (l) (with the notation of the cited 
lemma, S? = Jf?, g = p, Kdi = t//3, e T = ifi and i = r). It follows that, for x < 1, 

V+(x + <£(•), ¥(■)), •) < E + (^('). Y (-)) > 0 a - s -- 

rG0 

and almost surely for x > 1, 

V+(x + <£(•), Y(-)>, ■) < E i V+ ^ + - y (0>»0 + <?(■)] • 

rG© 

by Assumption 4.6. Note that if r is such that {1 + (r//3(-), Y (•)) < 0} has strictly positive 
probability then on this set the preceding inequality holds true since C > 0 a.s. 

Applying the same assumption again (and with the same remark), we get a.s. that 


V+ 




< 


< 


< 


1 

£ T {- 

) T 

1 


£r(- 

)7 

1 


£ r(-. 

) T 

1 


£ r(\ 

) T 




V + (e T (-) 

V+(e T (.) [1+ (g(-),¥(■))]+ e T (.) 

V + + ( 5(0 >^(')} + £ t (-) 

[V+(l + (g T (-),Y(-)),-) + C(-)], 


C(-) 

+C(-) 

-s(-).n)).-) +c(-) 


where the last inequality holds true since 1 + (g, Y) >0 a.s. Now let 



[y+(i + (^(-),Y(.)),-) + C'(-)] +<?(•) 


^ + (o,-), 


where the last term is added to cover the case x = 0 as well. By assumption, Ep [C| < Too 

a.s., and by Assumption 4.4 we haveEp[P + (l + (g T (-), Y (-)), -)| Sf] < Too andEp[P + (0, < 
Too a.s., so the proof is complete since e T is ^-measurable. □ 
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Proof of Lemma 4-9. Let us first choose, for each positive rational number q , a version 
F{q, w) of esssup ?eHd(9) E P [V(q + (£(■), Y(-)} 

Next, for any pair q\ < q 2 of positive rational numbers, and any £ £ E d (qi), one has 
£ € S d (q 2 ), as obviously qi + (£, Y) < q 2 + {£, Y). So we have by Assumption 4.3 that 

V(q x + (£(w), Y (w)}, w) < V(q 2 + (£(w), Y (w)}, w) 

for P-a.e. w £ f2. We then conclude from the monotonicity of the conditional expectation and 
taking essential supremum that F(qi,-) < F(q 2 ,-) a.s. Similarly, for every positive q £ Q, 
w) < +00 from Assumption 4.4. Thus one can find a set A £ of full probability such 
that, for every w £ A, the mapping q 1 —> F(q,u>) is non-decreasing and finite-valued on the 
set of positive rational numbers. 

So let us specify, for each x £ [0, + 00 ) and oj £ A, 

G(x, ui) = inf F(q, w), 

qm 

q>x 

and define G(x,oj) = 0 if u> £ fi \ A. Clearly, when x > 0 is in Q then G(x,-) > F(x,-) 
a.s. In addition, for each x > 0 we have that G(x,-) is ^-measurable. We shall split the 
remainder of the proof into five separate parts. 

(i) With the above definition, it is straightforward to check that, for each w £ Cl, the 
function G(-,ui) is non-decreasing. It is also clear that G(x, w) < +00 for all x > 0 
and ui £ Cl. 

(ii) We proceed to show that, for all x £ [0, + 00 ), 

G(x, ■) = esssupE P [F(a; + (£(•) ,Y(-)),-)\ C S) a.s. 

In order to do so, let us fix an arbitrary x £ [0, + 00 ). Then, for every q £ Q, q > x, 
the inequality 

esssu P Ep[V(a; + (£(■) ,Y(-)), -)| if] < F(q, ■) 
holds a.s., thus we get 

esssupEp[V(a; + (£(•), Y(-)) ,-)|^] < G(x,-) a.s. 

(£S d (x) 


It remains to verify that the reverse inequality is also true (except possibly on a set of 
measure zero). This will be achieved in three steps. 


(a) Let us start by taking a strictly decreasing sequence {q n \ n £ N} of rational num¬ 
bers satisfying x < q n < x + 1 and lim n ^ +00 q n = x. Now, given any n £ N, it 
is straightforward that the family {Ep [V{q n + (£(•) ,Y(-)) , -)| Sf]; £ £ E d (q n )} is 
directed upwards, therefore one can find £ n £ E d (q n ) such that 

Ep [V(q n + (£„(■), 01 #1 >F(qn,-)~l a.s. 


(b) Next, fix an arbitrary n. It was observed above that £ n £ H d (q n ) C E d (x + 1). 
Thus, taking £ n to be its projection on D, we know that 


Ep 


v(q n + (CnO), Y(-)) , ■) | Sf] = Ep [V(q n + (£„(■), ¥(■)), -)| Sf] 


> F(q n , ■) -a.s. 

n 


( 6 . 1 ) 
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Moreover, Lemma 4.7 allows us to conclude that ||£ n || < K x+ \ a.s. Therefore, 
we can extract a random subsequence fc £ n| such that limfc-^+oo C, nk = ( 

a.s., for some ^-measurable random variable ( (see Lemma 2 of [13]). But then 

x + (CM ,y(w)) = fc hm Q (q n ^ u) + (c„ fc ( w )M ,L(w))) > 0 

for P-a.e. ui £ 12, i.e. ( £ 3 d (a:), which in turn implies that 

ess supE P [ V(x + <£(•), ¥(■)) , -)l #1 > MV(x + «(•), Y(-)) , -)| &} a.s. (6.2) 


(c) Finally, let us define the random variables // : 12 —»• R as follows, 

/fcM = v(q n ^ u ) + (c„ fc ( w )M ,y(w)) , w £ 12. 

By construction of the sequence {q n \ n £ N} and of the random subsequence 
|Cnfej fc £ n|, and by the continuity of the paths of V (see Assumption 4.3), it is 
clear that lim;.^ +oc f k = V(x + (£(•), F(-)), •) a.s. We further observe that, for 
P-a.e. uj £ 12, 

/fcM < V^x + 1 + (Cn fc O)( w ) ,y(w)^ < (1 + x) 1 + 1 L'(oj ), 


where the first inequality follows from the monotonicity of V (again we refer to 
Assumption 4.3), and the second inequality is a simple consequence of Lemma 4.8 
combined with the fact that 


X + 1 + (Cn k (-){-) > Qn k {-) + (C7T.fc() (•) >^(")^ > 0 a - S - 


Hence, we may apply Fatou’s lemma (for the limit superior) to conclude that 


E P [V(x + (a-),Y(-)),-)\m >limsupE P [/ fe |Sf] 

k— >+oo 


> liminf 

k— >-+oo 




1 

rife(-). 


> inf F(q n ,-) a.s., 

nGN 

(6.3) 


from ( 6 . 1 ) applied on {rik = i} for i > k. 

Combining equations (6.2) and (6.3) finally gives the intended inequality 


esssupEp]F(a: + (£(•), F(-)}, -)| Sf] > inf F(q n , ■) > G(x, •) a.s. 
£eE d (x) neN 


(in) Thirdly, G is, by construction, right-continuous. Moreover it is easy to see that 
G{x,u) = 1a(w) inf {F(r n ,u)t {rn>x} + (+oo)l {rn<x} } 

where {r n ; n G N} is an enumeration of Q (we make the usual convention that Oxoo = 
0). Recalling that w —> F(r n ,oj) is ^-measurable for each r n , it follows that G is 
measurable with respect to the product cr-algebra &([0, + 00 )) <S> 

(iv) Now consider an arbitrary ^-measurable random variable H > 0 a.s. We wish to show 
that 

G{H{.) , •) = esssup E P [F(iL(.) + (£(•), ¥(■)) , -)| &} a.s. (6.4) 

Z&s d (H) 
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We have just proved above that (6.4) holds true for a non-negative constant H. It is 
easy to show that it holds also true for ^-measurable countable step-functions H. 

Next, suppose H is any bounded, ^-measurable, non-negative (a.s.) random variable, 
so there exists some constant M > 0 such that H < M a.s. It is a well-known fact that 
we can take a non-increasing sequence {H n \ n £ N} of ^-measurable step-functions 
converging to H a.s., and such that, for every n £ N, H n < M a.s. Then, fixing an 
arbitrary £ £ 2 d (H), we have for every n £ N that H n + (£, Y) > H + (£, Y) > 0 a.s., 
therefore 


G(H n (-),.)= esssup E P [V(H n (-)+ (((■),¥(■)),■)]&} 

>E P [V(H n (-) + <£(•), Y(-)),-)\&] a.s. 

(recall that (6.4) is true for step-functions), which in turn yields 

liminf G(H n {-), ■) > liminf E P (V(H n (-) + <£(•) ,¥{■)) , -)|^] a.s. 

n—>-+oo n—>-+oo 

On the one hand, we get by right-continuity of G that limn^+oo G(H n (-), •) = G(H (-), •) 
a.s. On the other hand, we can apply Fatou’s lemma (for the limit inferior, see As¬ 
sumption 4.5) to conclude 

liminf E P (V(H n (-) + <£(•), ¥(■)),-)\&] > E P [V(H(-) + <£(■), ¥(■)),-)| &\ a.s., 

n—>•+oo 

hence ess sup^ gH d( ff ) Ep[F(iL(-) + (£(•), F(-)), -)| Sf] < G(H (-), •) a.s. (by the arbitrari¬ 
ness of £ £ 2 d (H)). Now, to prove the reverse inequality, we can construct (as in 
part (ii) of this proof) a sequence {( n ; n £ N} such that, for every n £ N, we have 
( n £ 2 d (H n ), ( n (uj) £ D(oj) for P-a.e. w £ 11, and 

G(H n (-) ,■)--= esssup Ep [V(H n {-) + (£(•),¥(■)), -)| &\ ~ - 

n fes d (H n ) n 

< E P [V(H n (-) + {Cn(-),Y{-)) ,-)|Sf] a.s. (6.5) 

We remark further that each ( n belongs to 2 d (M) (because M + (( n ,F) > H n + 
{( n ,Y) > 0 a.s.), so by Lemma 4.7 there exists a random variable Km such that 
II(nil < Ajvf a.s. Therefore we can select a random subsequence {£„ fc ; k £ N} with 
linifc-^oo ( nk = ( a.s., for some Sf-measurable £. Clearly, 

H+{C,Y)= lim (H nk + (( nk , Y)) a.s., 

fc—>• + OO 


and for every k £ N, 

+oo 

Hn k + (( n k ,Y) = ^ (Hi + (( i,Y)) } > 0 a.s., 

i=k 


hence ( £ 2 d (H). Consequently, 

esssup E P [V(ff(-) + (£(■),¥(■)),■)!&] > E P [V(H(-) + <((■),y(-)>,01 &1 a -S-, 

tes d (H) 

by definition of essential supremum. Besides, we have by Lemma 4.8 that, for every 
k£ N, 

V + (H nk{ .)(.) + <(„,(.)(■) ,¥(■)) r )<V + (M+ ((„,(.)(■) ,¥(■)) , ■) < L M (-) a.s. 
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(note that ( nk £ 5 d (M)), so the limsup Fatou lemma yields (cf. Assumption 4.4) 

Er[V(H(.)+ (((■),¥(■)),■)!&] 

> limsupEp[ V(H nk (.) (•) + (&„(.)(■), Y(-)) ,')\&\ 

fc—»•+ oo 

> limsup (■),■) -- j-r) =G(H (•),•) a.s., 

k—t+oo \ ^k\ ) J 

where the last inequality follows from (6.5). Combining the inequalities above, we 
establish (4.7) for any bounded H as well. 

Finally, we extend the above result to an arbitrary ^-measurable H > 0 a.s. Since 
H = with each H n = HTL{ n -i<H <n } ^-measurable and bounded, we can 

obtain the desired equality from the bounded case. 

(v) Lastly, we claim that almost all paths of G are left-continuous. This will be done by 
constructing some left-continuous function G such that 

P{w £ f 1: V x > 0, G(x,uj) = G(x,uj)} == 1. 


We define 

7 = 7 / a ( sup g(E Q G(g, w), if x > 0, 

G{X,0J) = < 9 <z 

[ G(0, w), otherwise. 

From (in) recall that G is &([0, + 00 )) 0 ^-measurable, so it is obvious that G is 
^([0,+oo)) 0 ^-measurable too. Besides, it is trivial to check that, for every w £ 
il. the function G(-,w) is non-decreasing on (0,+ 00 ). We remark further that, by 
construction, all paths of G are left-continuous on (0, +00). 

It follows immediately from the monotonicity of all the sample paths of G that the 
inequality G(x, to) > G(x, ui) holds true simultaneously for every x > 0, for every 
w £ fi. In particular, this gives that, for every uj £ 12 and for all x > 0, it holds that 
G(x,lo ) < +00. At last, we shall show that P{w £ fl: Va; > 0, G(x,co) = G(x,uj)} = 
1 . 


(a) The proof is by contradiction. Let us suppose that the set 

f2i = {w £ 12 : 3x > 0 s.t. G(x,lj) > G(a7 ,w)} 

has strictly positive measure, i.e., P(I2i) > 0. Note that, because (fl,^,P) is a 
complete measure space, we can apply the measurable projection theorem (see e.g. 

Theorem 4 in Sainte-Beuve [22]) to deduce that 3 12 1 = Proj^^G — G) 1 ((0, + 00 ))^ 
belongs to Sf. 

Consider the multi-function S : 12 =1 [0, + 00 ) given by 

\ A / { 2 ; > 0: G(x,lo) > G(x,u;)} , if w £ fii, 

^ \ {1}, otherwise. 


Its graph is given by 


gpli/? = (f I 1 ) x {!}) U x ( 0 , +00)] n 


(G-G) '(( 0 , +00)) 


) 


3 Given a set E Cl x Y, we recall that the projection of E on X is 


Proj^-(.E) = {r G X: 3y G P such that (x,y) G E} . 
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and belongs to &([0, +oo) ) <g) Sf. Consequently, we can apply the von Neumann- 
Aumann theorem (see e.g. Theorem 3 in Sainte-Beuve [22]) to produce a im¬ 
measurable selector H : 12 — > [0, +oo) of S. In particular, this implies that 

P {w e 12: G(H(ui) , w) > G{H(u) , w)} > P(12i) > 0. ( 6 . 6 ) 


As G(0, w) = G( 0, u>), we get that H > 0. Furthermore, we may and shall assume, 
without loss of generality, that there exists some e £ (0,1] such that H > e. 

(b) On the other hand, we shall see that G(H(uj) ,uj) < G(H(u>) ,w) holds for P-a.e. 
w G 12, contradicting (6.6). 

Firstly, fix an arbitrary n £ N. As in part (ii) of this proof, it is possible to 
construct some ( n £ 2 d (H) such that, for P-a.e. w £ 12, 

Ep[V(ff(.) + (Cn(-), r(-)> , 01 Sf]M > G(H(u) (6.7) 

n 

Next, setting for every m G N (recall that H > e), 

/£» = v(h( U ) - ^ + H{U H( u ) /m (CnM ,Y(u>)) w 6 12, 

it is trivial by continuity (see Assumption 4.3) that {/™; m £ N} converges a.s. 
to V(H(-) + (Cn(0 , y(0), 0 as m—> +oo. Thus, Fatou’s lemma gives 


lim inf Ep 


Ifn 


> Ep[V+(H{-) + (Cn(0. y (0),0|^] a.s. 


Secondly, we note that, for each to £ N, the random vector (H — e/m) /H 

belongs to 2 d (H — e/m), because 


H —— + r) = ^5 (« + «„, r)) > 0 a.s. 

m \ H / ti 


(recall that H > e and </ n £ 2 d (H)). 

Therefore, given Assumption 4.5 and the fact that, for every to £ N, the inequality 
]/™] _ < y(0, •) is true a.s., we can apply the limsup Fatou lemma to obtain 


lim sup Ep 

m —>-+oo 


[fn 


<E P [V~(H(-) + (U-) ,Y(-)) ,-)\<S\ a.s. 


Combining both inequalities yields 


limmfE P [/™|Sf] >E p [V(H(.) + (U-),Y(-)),-)\&\ a.s., 

m —>+oo 


and from (6.7) we get 


lim inf E P [/™| Sf] > G{H (-), •) - - a.s. 

m—>•+oo fi 


( 6 . 8 ) 


Besides, for every to £ N we have that 


ess sup Ep 

££5 d (H—e/m) 


v (#(•)-^+ <£(•),no,-)| y\ >MfnW\ a. s ., 


and so 


lim inf ess sup 
m_H_0 ° £<z S d(H-£/m) 


Ep 


V 


(h,. 


e 

m 


m,Y (■)),■) 


> lim inf E P [ f™ | a.s. 

m—>■+oo 
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On the other hand, let m £ N be arbitrary, but fixed. Then we know by the 
preceding step that 


ess sup Ep 

d (H—e/m) 



£ 

m 


<£(•), F (•)>,•) | ^] (w) = g(h M 



for every u; outside a P-null set. Using (6.8), we get 

liminf g(h{-)~ —>G(H(-),-)~- a.s. (6.9) 

m— h-oo V m J n 

Next, choosing g m (w) £ Q, g m (w) > 0 such that H(oj) — e/m < g m (w) < H(u), 
it follows immediately from the definition of G (recall that H > e > 0) and from 
the monotonicity of G (see the first part of this proof) that 

G(H(u),u)= sup G(q,uj) > G(q m (uj),uj) 

q<H(uj ) 

> G(H(uj) — e/m, w) > inf G(H(uj) — s/k, w ), 

k>m 


consequently, 

G(H(•),■)> sup inf G(H(-) — e/k, ■) = liminf G(H(-) — s/m, ■) a.s. 

ra£N k~>m m —>-+oo 


So, from (6.9), for every b£H, G(H (-), •) > G(H (■), ■) — 1/n a.s., hence 
G(H{•),■) >limsup (G(H (•),•)--) =G(H(-),-) a.s., 

n —»-+oo \ Tl y 


as claimed. □ 

Proof of Proposition f.10. As in (ii) of the previous proof, one can show that there exists 
some sequence £ n ( - ) G S d (ff) that attains the essential supremum in (4.7). We may assume 
that £„(•) £ D(-) a.s., and hence for every n £ N we have by Lemma 4.7 that ||£„(-)|| < 
H(-) //?(•) a.s. Next, Lemma 2 of Kabanov and Strieker [13] implies the existence of a im¬ 
measurable random subsequence {£ nfc ; k £ N} such that limfc _ ) ._)_ 00 £„,,(.)(•) = £(•) a.s. for 
some ^(-) £ 2 d {H). Lemmata 4.8 and 4.9 allow the use of the (conditional) Fatou lemma, 
hence we get that f{H) (•) = ^(-) is as claimed. □ 
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